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FINE MOTOR CONTROL REHABILITATION 
RELATED APPLICATIONS 

This application claims the benefit under 1 19(e) of a US provisional application serial 
number 60/542,022, filed February 5, 2004, and US provisional application number 
5 60/566,079 filed on April 29, 2004, the disclosure of both applications are incorporated herein 
by reference. This application is also related to PCT applications, being filed on same date and 
by the same applicant as the present application, entitled "Gait Rehabilitation Methods and 
Apparatuses"; "Rehabilitation with Music"; "Neuromuscular Stimulation"; "Methods and 
Apparatuses for Rehabilitation Exercise and Training"; "Methods and Apparatus for 
10 Rehabilitation and Training"; "Methods and Apparatus for Rehabilitation and Training"; 
"Methods and Apparatus for Rehabilitation and Training"; and having attorney docket 
numbers, 414/04391; 414/04396; 414/04400; 414/04388; 414/04213, 414/04404; 414/04405, 
respectively. The disclosures of all these applications are incorporated herein by reference. 

FIELD OF THE INVENTION 
15 The present invention relates to methods and apparatuses for rehabilitation, activity 

assistance and exercise, for example for rehabilitation, assessment, assistance and exercise 
with activities such as eating and writing. 

BACKGROUND OF THE INVENTION 
Strokes, accidents and other medical conditions can cause a person to lose the ability to 
20 control fine motor actions, for example, those required for handwriting and for eating with a 
fork and spoon. During a lengthy rehabilitation process, a patient is taught anew to control the 
limbs. 

While many rehabilitation methods have been developed, for various reasons patients 
do not keep to the methods and/or for other reasons do not reassume a reasonable level of 
25 control. 

SUMMARY OF THE INVENTION 

A broad aspect of some embodiments of the invention relates to rehabilitation of fine 
motor control, for example using a finger-manipulated object. In an exemplary embodiment of 
the invention, the position and/or orientation and/or force on the object are reported to a 
30 controller and/or are set by the controller. Optionally, the object is used in a real world setting. 
Optionally, one or more gross-motor movements of the patient are limited or are rehabilitated 
simultaneously with the fine motor control. 

A broad aspect of some embodiments of the invention relates to rehabilitation in which 
fine motor and gross motor control are rehabilitated simultaneously through the use of a single 
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integrated device. Optionally, positional feedback or positional control is provided by the 
device to a controller and/or a patient. 

An aspect of some embodiments of the invention relates to a fine-motor control 
rehabilitation device, for example, a pen, which is used for emulating and/or as part of real- 
5 world activities, such as writing, while allowing the rehabilitation device to apply force to the 
patient's hand (or other fine motor control source). Optionally, the applied force can be applied 
to guide the pen in a desired manner, or constrain its movement. Optionally, the device is re- 
locatable with respect to a real-world activity location, for example a table. Optionally, gross 
motion of a patient's limb is prevented, controlled and/or monitored using a suitable means 

10 attached to a user's arm. 

An aspect of some embodiments of the invention relates to use of the system for 
activity assistance. For example, the system is optionally used for assisting a person with 
writing. In such an embodiment, a person could write letters and words in response to writing 
cues provided on the writing surface. 

15 Optionally, the system is used to assess the condition of a person while attempting to 

perform a certain activity. For example, the deficiencies of a person's eating motion are 
recorded and/or analyzed as the person performs the motions while using the system. Via 
direct observation of an attending medical professional and/or sensed observation through the 
system, deficiencies can be analyzed and targeted for exercise and/or rehabilitation. 

20 In an exemplary embodiment of the invention, such a pen (or any other rehabilitation 

device) is movable in several degrees of freedom, for example, orientation and planar position. 
Optionally motion along the pen axis is supported as well. Optionally, motion is limited, for 
example by design, to the type of motion needed for the rehabilitation task. 

Optionally, motion of the pen can be set or constrained by a rehabilitation system. 

25 Alternatively or additionally, such motion is measured or assisted by a rehabilitation system. 
Optionally, the pen includes one or more pressure sensors to determine a particular grip of the 
pen. Optionally, the pen includes one or more feedback points, for example, small vibrators, 
which allow a rehabilitation system to provide feedback to a user. 

In an exemplary embodiment of the invention, the pen moves in a plane of a table. 

30 Optionally, the pen is attached to the table, for example, being held from beneath the table. 
Alternatively, the pen is held from above the table. Optionally, the pen is mounted on a 
positioning system which can be moved and attached at various positions relative to a 
particular table or relative to other tables. 
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In an exemplary embodiment of the invention, the table includes means for sensing the 
pen usage, for example a pressure sensor, a tablet computer or other pen-detecting means 
known in the art, for example position and orientation sensors. Optionally, one or more images 
may be projected on the table, for example from below (e.g., a transparent table) or from 
5 above, or shown using the table as an active display. 

In an exemplary embodiment of the invention, the pen is mounted on a ball joint which 
allows spherical motion of the pen. Optionally, the pen includes an axial linear joint, for radial 
motion. Optionally, the ball joint is mounted on an X-Y table. 

An aspect of some embodiments of the invention relates to a system for rehabilitation 
10 of eating. Optionally, the rehabilitation system includes rehabilitation of fine motor control 
involved in manipulating a utensil and also rehabilitation of gross motor control involved in 
moving the utensil (e.g., from a plate to a mouth). Optionally, rehabilitation of the mouth 
and/or coordination of the mouth and hand, are also provided. In an exemplary embodiment of 
the invention, an eating utensil is held by the system in the air and can be moved over a path 
15 from a food container (e.g., a plate) to a user's mouth. Optionally, the rehabilitation system or 
a user can move the food container, so as to provide multiple rehabilitation situations in a 
session. 

Optionally, the rehabilitation system can feed a user automatically and/or complete 
incomplete user motions. In an exemplary embodiment of the invention, a patient is 

20 rehabilitated during daily activities, such as eating. Optionally, the rehabilitation system can 
detect the state of a mouth, for example whether it is open or closed. Optionally, the 
rehabilitation system can detect dropping of food, for example dropping from the utensil or 
from the mouth. Optionally, system includes a camera and suitable image processing for the 
detection of food dropping and/or various motion elements. 

25 In an exemplary embodiment of the invention, a rehabilitation system is provided 

which supports other fine motor tasks, for example, sorting and assembly. Optionally in such 
applications, the utensil held is a finger of the patient himself, for example, using a short 
rubber sleeve or ring that fits on a finger. 

An aspect of the invention relates to teaching fine motor control to patients who have 

30 lost control of their fingers. An instrument, such as a pen, can be attached to the end of the 
patient's forearm and the patient can be taught to write using the system described herein. 

In an exemplary embodiment of the invention, patients who use prosthetic limbs are 
taught fine motor control over their limbs in order to perform activities, such as eating and 
writing. 

3 
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In an exemplary embodiment of the invention, the system is adapted to be portable. 
Optionally, communication between various components of the system is wireless. Optionally, 
the system is powered by batteries. 

An aspect of the invention relates to analyzing a patient's motion while using the 
5 system for the patient's emotional state. Optionally, handwriting generated while using the 
system is analyzed to determine the patient's emotional state. A patient is optionally exercised, 
rehabilitated, and/or assisted based on the emotional state. For example, the system could 
provide the patient with soothing music or could ease the motion routine based on the detected 
emotional state. 

10 There is thus provided in accordance with an exemplary embodiment of the invention, 

apparatus for rehabilitation, comprising: 

a utensil adapted to be hand held and manipulated using fingers and be used in a real 
world task; 

a fine motion mechanism coupled to said utensil and adapted to apply force to said 
15 utensil, sufficient to move said utensil. 

There is also provided in accordance with an exemplary embodiment of the invention; 
apparatus for rehabilitation, comprising: 
a utensil; 

a fine motion mechanism adapted to move said utensil in at least three degrees of 
20 freedom; and 

a gross motion mechanism adapted to move said fine motion mechanism, in at least 2 
degrees of freedom. 

There is also provided in accordance with an exemplary embodiment of the invention; 
pen rehabilitation apparatus, comprising: 
25 a surface; 

a pen extending up from the surface; and 

a motion mechanism adapted to change the orientation of the pen, under the surface. 

There is thus provided in accordance with an exemplary embodiment of the invention, 
an apparatus for rehabilitation, comprising: 
30 an object adapted to be hand-held by a person and manipulated using the fingers to 

perform a task; and 

a fine motion mechanism coupled to said object and adapted to apply sufficient force 
to move the object. Optionally, said apparatus weighs less than 30 kg. 
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In an exemplary embodiment of the invention, said object is adapted to be translated 
along a surface. 

In an exemplary embodiment of the invention, said mechanism has a range of motion 
of less than 20 cm. 

5 In an exemplary embodiment of the invention, the apparatus comprises a controller that 

analyzes motion of the object to determine at least one characteristic of the person. 

In an exemplary embodiment of the invention, the controller analyzes force applied to 
the object to determine at least one characteristic of the person. 

In an exemplary embodiment of the invention, the characteristic comprises an 
10 emotional state of the person. 

In an exemplary embodiment of the invention, said controller has stored therein 
patterns of motions. Optionally, said patterns include writing patterns. 

In an exemplary embodiment of the invention, said fine motion mechanism resists 
motion of said object by the person. 
15 In an exemplary embodiment of the invention, said fine motion mechanism applies 

resistance to motion of said object. 

In an exemplary embodiment of the invention, said fine motion mechanism assists with 
the movement of said object. 

In an exemplary embodiment of the invention, said object is equipped with at least one 
20 feedback source which imparts a stimulus to a user of the apparatus. 

In an exemplary embodiment of the invention, the apparatus further comprises at least 
one sensor to track motion of said object. 

In an exemplary embodiment of the invention, the apparatus further comprises at least 
one sensor to track force applied to said object. 
25 In an exemplary embodiment of the invention, said mechanism damps motion of said 

object. 

In an exemplary embodiment of the invention, the apparatus further comprises a gross 
motion mechanism adapted to move said fine motion mechanism, in at least 2 degrees of 
freedom. Optionally, said gross motion mechanism is adapted to move said object from a table 
30 to a mouth of a patient. Optionally, said object comprises a chopstick. 

In an exemplary embodiment of the invention, the apparatus further comprises a 
separate gross motion mechanism adapted to be attached to a person having said fingers and 
whose movement is coordinated with movement of said object. 
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In an exemplary embodiment of the invention, the apparatus further comprises a 
surface for said object to touch and which surface also functions as a display. Optionally, said 
surface comprises a tablet computer. 

There is also provided in accordance with an exemplary embodiment of the invention, 
5 an apparatus for rehabilitating motor control functions related to writing, comprising: 

a surface; 

a stylus extending upwards from the surface; and 

a motion mechanism located under the surface that is adapted to change the orientation 
of the pen relative to the surface. Optionally, said motion mechanism is adapted to move said 
10 stylus on said surface. Alternatively or additionally, said motion mechanism is adapted to be 
moved by a person holding the stylus. 

In an exemplary embodiment of the invention, said apparatus is adapted to measure a 
force applied to said stylus. 

In an exemplary embodiment of the invention, said apparatus comprises a controller 
15 having at least one pattern of motion stored therein. Optionally, said controller controls said 
motion mechanism responsive to said pattern. Alternatively or additionally, said controller 
measures a mental state of a patient responsive to motion of said motion mechanism. 

There is also provided in accordance with an exemplary embodiment of the invention, 
a method of fine motor control rehabilitation, comprising: 
20 providing an object to be manipulated by fingers of a patient; and 

controlling an actuator coupled to the object to provide assistance to movement of the 
object, said actuator providing a range of motion to the object limited to less than 30 cm and 
having at least 3 degrees of freedom of motion. Optionally, said assisted motion comprises 
writing. Alternatively or additionally, said assisted motion comprises eating. 
25 There is also provided in accordance with an exemplary embodiment of the invention, 

a method of assisting a person in a daily task that involves controlling arm and finger motion 
comprising: 

determining at least one characteristic of the task; and 

using a robotic actuator to assist arm and/or finger motion. Optionally, the method 
30 comprises assisting only if said act fails to complete. Alternatively or additionally, the method 
comprises assisting as a safety measure. Alternatively or additionally, the method comprises 
assisting periodically as part of a rehabilitation process. 



6 



I 



WO 2005/075155 PCT/IL2005/000139 

BRIEF DESCRIPTION OF THE FIGURES 

Non-limiting embodiments of the invention will be described with reference to the 
following description of exemplary embodiments, in conjunction with the figures. The figures 
are generally not shown to scale and any sizes are only meant to be exemplary and not 
5 necessarily limiting. In the figures, identical structures, elements or parts that appear in more 
than one figure are preferably labeled with a same or similar number in all the figures in which 
they appear, in which: 

Fig. 1 is a schematic block diagram of a fine motor control rehabilitation system, in 
accordance with an exemplary embodiment of the invention; 
10 Fig. 2 is a perspective view of a portable pen-type rehabilitation system, in accordance 

with an exemplary embodiment of the invention; 

Fig. 3 is a detailed view of a fine motion mechanism for the pen of Fig. 2, in 
accordance with an exemplary embodiment of the invention; 

Fig. 4 is a detailed view of an under-the-table pen motion mechanism, in accordance 
15 with an exemplary embodiment of the invention; and 

Fig. 5 is a perspective view of an eating rehabilitation system, in accordance with a n 
example embodiment of the invention. 

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS 

OVERVIEW 

20 Fig. 1 is a schematic block diagram of a fine motor control rehabilitation system 100, 

in accordance with an exemplary embodiment of the invention. The system 100 is also 
optionally used for activity assistance, exercise and assessment 

A patient 128 to be rehabilitated holds a utensil 101, for example a pen or a fork. The 
rehabilitation activity generally includes fine motor motion of utensil 101 relative to a 

25 reference 103 (e.g., a table) and one or more targets 105 (e.g., the table, a plate, a mouth), 
which may serve as reference 103. A support structure 107 is optionally provided so that 
system 100 can move utensil 101, or resist motion thereof. The rehabilitation process is 
optionally managed by a controller 102 which optionally receives input from various sensors 
and/or generates movement commands. In a particular class of rehabilitation activities, system 

30 100 allows motion of utensil 101 only within certain ranges of positions and/or orientations. 
Exceeding these ranges, as detected by the sensors, may, for example, increase resistance to 
motion or generate an audio or visual feedback. 

For fine motor rehabilitation, a fine motor mechanism 110 is provided, which for 
example, moves utensil 101, applies force thereto and/or measures force applied thereto. More 
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complex control can be applied as well, for example, assisting motion by patient 128 can 
include of sensing motion and then applying force in the direction of that motion. 

For combined fine and gross-motor rehabilitation, a gross-motion mechanism 108 is 
provided, which allows/supports/detects gross motion of the utensil. 
5 Optionally, one or more target sensors 106 are provided, which generate signals 

indicative of the condition of the target (e.g., mouth open, pressure level from utensil) and/or 
proximity of the utensil to the target (e.g., using absolute or relative measurement). 

Optionally, one or more fumble sensors 104 are provided, which generate signals 
indicative of a failure to use utensil 101 correctly. In one example, a camera detects food 
10 falling off of a fork. In another example, a camera detects ink blotches caused by a pen being 
used incorrectly. 

Optionally, one or more grip sensors 112 are provided, which generate signals 
regarding the quality or other properties of the gripping of utensil 101 by patient 128. In one 
example, a pen includes pressure sensors which indicate points along the pen where pressure is 
1 5 being applied by a hand and/or the pressure level. 

Optionally, a task is structured using a display provided to the user using a display 1 14. 
In one example an image is projected onto reference 103 (and optionally serves as a target). In 
another example, one or more of the targets is a display object. 

Optionally, one or more utensil sensors 1 16 are provided, for generating feedback on 
20 the location and/or orientation of the utensil. In some cases, for example in a pen, the fine 
motion mechanism may not control all the degrees of freedom and a utensil sensor 116 
supplies data regarding one or more additional degrees of freedom. 

Optionally, one or more feedback providing means 1 18 are provided on utensil 101. In 
one example, utensil 101 includes a vibration applying element or a force applying element for 
25 indicating feedback to patient 128 on correct and/or incorrect moves. 

In an exemplary embodiment of the invention, system 100 focuses on control and 
detection of utensil 101. In other embodiments, additional reference points on a patient may be 
controlled and/or measured. In one example, an elbow brace and movement mechanism (e.g., 
an other limb control 120) may be used to monitor and/or control arm motion during a feeding 
30 rehabilitation activity. 

In an exemplary embodiment of the invention, utensil 101 is permanently attached to 
system 100. Optionally, however, system 100 includes a means to rapidly attach and detach 
utensil 101. In one example the means comprises a rubber coated pincer. In another example, 
the means comprises a hollow tube which fits over the handle of the utensil. In another 
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example, a bayonet connection is used for quickly changing utensils. In another example, a 
ring or sleeve which fits on a finger is used to control the finger of the patient as a utensil. 

Optionally, controller 102 is designed for interaction with a user (e.g., patient 128 or a 
therapist), for example, using a user input device(s) 122 and/or a display(s) 126. Optionally, a 
5 link 124 is provided to a remotely located computer, rehabilitation device, database and/or 
therapist. Controller 102 optionally includes storage for storing results and/or programs for 
one or more patients. 

It should be appreciated that a rehabilitation system in accordance with an exemplary 
embodiment of the invention does not need to include all the elements shown in the figure. In 
10 particular, it should be noted that a wide range of activities can be rehabilitated. In one 
example, writing, most (or even all) of the motion of the tip of a pen can be in a single plane, 
and rotation of the pen around its axis may usually be ignored. In another example, eating, 
both fine and gross motor control are needed and fine motor control is needed over a range of 
spatial locations (typically at least the plate and the mouth areas). 
15 In an exemplary embodiment of the invention, system 100 is used to control the 

movements of patient 128, as part of a rehabilitation process. As system 100 includes both 
sensors and actuators, various movement options may be provided. For example, one or more 
of the following movement control options may be provided: 

(a) System 100 can prevent unwanted movements. 
20 (b) System 100 can allow increased patient freedom to pursue movements, as 

rehabilitation progresses. 

(c) A user can set the freedom level. For example, the movement level can be one of 
"automatic movement", "user triggered automatic movement", "resistance to user movement", 
free movement". 

25 (d) Movement safety and efficacy, for example, not moving unless the patient is 

gripping correctly (or at all) the utensil. 

In some embodiments of the invention, the system assists a patient with the motions of 
writing. Optionally, the system uses writing cues to assist a patient with writing. Optionally, 
the system supports hand writing optical character recognition ("OCR"). 

30 In an exemplary embodiment of the invention, the system analyzes a patient's motion 

while using the system for the patient's emotional state. Through the use of sensors, such as 
grip sensors, motion sensors, and position sensors, the system can optionally determine 
emotions of the patient as disparate as frustration and relaxation. Optionally, handwriting 
generated while using the system is analyzed to determine the patient's emotional state. A 
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patient is optionally exercised, rehabilitated, and/or assisted based on the emotional state 
detected. For example, the system could provide the patient with soothing music or could ease 
or make harder the motion routine based on the detected emotional state. 

It should be understood that based on the description herein, the system is optionally 
5 used for assessment, rehabilitation, activity assistance and/or exercise of a patient. Activities 
optionally include eating, writing and/or any other activity requiring fine motor control In 
some embodiments of the invention, rehabilitation instruments, such as a pen, are attached to 
the end of a patient's forearm to teach Fine motor control (e.g. for those patients who have lost 
the ability to control their fingers). Optionally, patients with prosthetic limbs are taught fine 

10 motor control using the system. Additional possibilities (non-limiting) are described below. 
EXEMPLARY EMBODIMENT 

Fig. 2 is a perspective view of a portable pen-type rehabilitation system 200, in 
accordance with an exemplary embodiment of the invention. While system 200 could be 
integrally attached to a table 202, in an exemplary embodiment of the invention, a coupling 

15 204 is used to selectively attach system 200 to table 202. Optionally, this allows system 200 to 
be attached to a station where a patient is used to carry out his activities and/or wishes to carry 
out his activities on, for example, a favorite desk or a replica thereof. Optionally, 
communication between various elements of the system is wireless. Optionally, the system is 
powered by batteries. In an exemplary embodiment of the invention, system 200 comprises an 

20 extendible arm 206 which can be used to position system 200 so that it's active area (e.g., 
where the rehabilitation activity is carried out) is at a convenient position. Arm 206 is then 
optionally locked. In other embodiments of the invention, arm 206 is capable of movement, 
position sensing and/or applying force in a desired manner. 

At an end of arm 206 and optionally supported thereby is a pen motion mechanism 208 

25 adapted to move, apply force to and/or measure movement of a pen 210. Mechanism 208 is 
shown in greater detail in Fig. 3. A writing target 212 is also shown, for use with pen 210. An 
optional sensor 214 may be used, for example for determining a relative position of pen 210, 
movements of pen 210 and/or for imaging the rehabilitation activity area. 

As can be noted, not all the elements of Fig.l are needed or provided. Optionally, 

30 additional elements which are useful to rehabilitation, assistance and/or exercise are provided, 
for example cameras, projectors and other elements described herein and/or are known in the 
art. 

WRITING SURFACE 

10 
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Writing target 212 can be of various types. In an exemplary embodiment of the 
invention, target 212 is a simple sheet of paper. This has the potential benefits of cost, 
convenience and being natural. Optionally, a pattern, for example a geometric pattern or a 
written pattern is provided on the paper, to be followed by the patient. Optionally, system 200 
5 forces (or urges) patient 128 to follow the pattern. Alternatively, the system monitors free 
attempts to follow the pattern. Alternatively, a patient may be forced or urged to follow an 
invisible pattern, or attempts to follow such a pattern (e.g., pattern described using speech) are 
monitored. 

Optionally, an image source within mechanism 208 is provided for projecting an image 
10 on the sheet, for example, projection from under the table or projection from pen moving 
mechanism 208. 

Optionally, pen 210 can elute ink. Alternatively, pen 210 is inert. In some 
embodiments of the invention, an erasable laminated sheet is used. In some embodiments of 
the invention, the writing task is performed in the air and not on a surface. Optionally, a hand 

15 rest is provided to make the task more realistic, for example a hand rest extending down from 
pen moving mechanism 208. 

In an alternative embodiment of the invention, a tablet device is used, for example, as 
known for tablet PCs, for PDAs and for stand alone tablets. Many types of pen detection 
mechanisms are known and can detect, for example, position, pressure, contact and/or pressure 

20 of hand on the writing target. 

Optionally, the writing target comprises a display for providing a task, feedback and/or 
instructions. An optional benefit of using the writing target as a display is that patient 128 is 
generally already looking at the surface, so he is attentive. Optionally, such a tablet device 
serves as controller 1 02, optionally using wireless connections. 

25 Optionally, the writing target records the actual material written by patient 128. If 

motion of the patient's hand is restricted, the writing target may correct for this effect, 
optionally in real-time so patient 128 can see the results of his efforts during his task. 

Optionally, the writing target (or other parts of system 200, such as mechanism 208) 
includes position and/or orientation sensing mechanisms. For example, optical, image based, 

30 ultrasound and RF sensing methods are known in the art. Optionally, not only is the location 
of the pen tip detected, but also the orientation in space, for example using orientation sensors 
or by detecting the position of the other end of the pen. Optionally, one end is detected by a 
tablet-like mechanism and the other end from the setting of mechanism 208. In some 
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embodiments of the invention, the writing target moves. Movement is optionally provided by 
placing the writing target on, or integrating the writing target with, an x-y movement table. 

In an exemplary embodiment of the invention, the tablet shows a shape and the person 
is required to trace the shape. The mechanism then measures the person's performance. The 
5 tablet reports to the robot the correct motion and the mechanism can nudge, move, resist 
movement of patient to help a correct motion to be achieved. 
PEN 

Various types of pens may be used, for example, a plain pen, pencil or marker may be 
held by mechanism 208. Optionally, another hand-held instrument is used in place of a pen, 

10 such as a chopstick. If a tablet mechanism is used, a suitable pen is optionally used. 
Optionally, the pen includes sensors to sense the contact pressure. Alternatively or 
additionally, the pen includes grip sensors, for example in the form of an array of pressure 
sensors distributed on the pen or on special contact points (e.g., three fingers and the area 
between the thumb and index finger). Optionally, the sensors are provided in a sleeve which 

15 can be mounted on an existing pen (or other utensil). Optionally, the pen is designed for a 
particular patient need, for example, to compensate for hand deformity or limitation in ability 
to control hand. Optionally, the pen is replaced or modified over time as rehabilitation 
progresses. Optionally, the pen includes one or more straps or a harness for mounting the pen 
on the hand (or an artificial prosthesis) of patient 128. 

20 In an exemplary embodiment of the invention, sensor measurements which are 

recorded during rehabilitation, activity assistance and/or exercise are stored, logged, and/or 
analyzed for example to provide a hard copy of results, plans, progress reports and/or other 
data. 

PEN MOVING MECHANISM 

25 Various types of mechanisms maybe used for moving pen 210. For example, one of the 

mechanisms shown in US provisional patent application 60/542,022, the disclosure of which is 
incorporated herein by reference, may be used. Alternatively, a robotic arm (optionally upside 
down) may be used. 

Depending on the rehabilitation treatment desired, the requirements from mechanism 
30 208 may vary. The requirements may include, for example, sufficiently short response time, 
ability (and level) to apply force, spatial stability, accuracy and/or precision. For example, one 
or more of the following rehabilitation-related activities may be provided by mechanism 208: 

(a) Moving the hand in a desired manner, as part of a complex motion or a complete 
complex motion (e.g., to compensate for a non-responsive hand or only for a non-responsive 
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portion). Optionally the system moves the utensil or is otherwise active when detecting the 
hand is there or responsive to any other command. 

(b) Moving the utensil against resistance from the patient. Also, vice versa, the patient 
moving the utensil against resistance by the system. 
5 (c) Nudging the hand in a desired direction, if deemed necessary, or as a reminder that 

a change in the motion is required. As noted above, vibration sources or other feedback 
mechanism may be provided in the pen itself. Vibration sources may be point sources, for 
example activated against a pen contact point with the hand. Alternatively or additionally, the 
entire pen may vibrate, for example to indicate that a motion is incorrect or that it has been 
10 completed and a new motion is expected. 

(d) Tracking motion and/or force, for example for diagnosis or to determine what the 
patient is doing with respect to what is expected or requested. Optionally, when a correct 
motion is detected 

(e) Assisting the patient -The pen motion mechanism may move the hand in the desired 
IS direction, as an assistance. 

(f) Damping. Pen 210 may serve to damp tremors in the patient f s hand, for example by 
actively applying a resistive force. 

(g) Be able to integrate into real-world activities, such as writing a letter in a manner 
that patient 128 is used to. Optionally, detecting letters and shapes and preventing moving out 

20 of shapes can be used to learn hand writing, even for non-handicapped individuals. However, 
system 200 may be advantageously used for preventing handicapped children from falling 
behind in studies. 

(h) Correct incorrect hand motions, for example, after a delay, for example, by 
retracting incorrect motions or by moving the utensil back to a different point on a correct 

25 trajectory. 

Fig. 3 is an enlargement of mechanism 208 and pen 210, in accordance with an 
exemplary embodiment of the invention. This motion mechanism includes three functional 
units, a pen holder 306, a rotary joint 304 and an x-y table 302. Other designs and/or 
rehabilitation processes can be provided as well, for example as described in the above 
30 referenced US provisional application. 

Optionally, a camera 344 is provided, to monitor the user movements. Optionally, a 
plurality of cameras are used to monitor user movements. A plurality of cameras is used, for 
example, to overcome view blocking by the hand and/or other body parts. Optionally, the 
plurality of cameras is used to construct a three dimensional image. In some embodiments of 
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the invention, images captured by camera 344 are used for later analysis. Alternatively or 
additionally, the camera is used for tracking the pen motion, instead of or in addition to other 
sensors. In another example, camera 344 is used for tracking the pen position relative to a 
"dumb" writing target 212 or for calibration of their relative positions. A variety of suitable 
5 image processing techniques are known in the art. Optionally, the hand, pen, pen holder and/or 
writing target are marked for easy automatic identification. In some embodiments of the 
invention, rehabilitation progress and/or exercise and/or activity assistance is monitored 
remotely using at least one camera. 
PEN AND PEN HOLDER 
10 In an exemplary embodiment of the invention, a simple pen holder 306 is provided, for 

example a hollow tube with an internal narrowing rubber insert. Optionally, a special pen with 
various interfaces (such as sensors) is used, and these interfaces are electrically supported by 
pen holder 306. 

Optionally, holder 306 is spring loaded so that it maintains the tip of pen 210 in contact 
15 with writing target 212. Optionally, holder 306 includes a sensor for determining the contact 
pressure of the pen, for example, to track lifting and pressing of the pen by patient 128. It 
should be noted that this pressure can be measured as a variation on the pressure caused by the 
spring. In general, the spring pressure, while not a constant, changes in a known way and/or 
can be calculated and/or calibrated for or treated as a slowly varying value. In other 
20 embodiments, the pen is attached to the surface, for example using magnetic attraction. 

Optionally, holder 306 includes a linear actuator for moving pen 210 towards and/or 
away from writing target 212. Many suitable linear actuators are known in the art and may be 
used. 

As noted above, pen 210 optionally includes one or more vibration sources 342, which 
25 may be local (vibrating only part of the pen or the hand holding the pen) or global (to vibrate 
the whole pen). 

As noted above, pen 210 may include pressure sensors for determining grip shape 
and/or pressure, for example one or more linear array of sensors 340. 
ROTARY JOINT 

30 In an exemplary embodiment of the invention, orientation of pen 210 is achieved using 

a joint which can rotate in space, optionally without twisting around the pen axis. Optionally, 
twisting is provided by pen holder 306, for example, free twisting, controlled twisting (e.g., 
using a motor in holder 306) and/or measurement of twisting. 
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In an exemplary embodiment of the invention, joint comprises a ball 346 that is 
mounted in a ring 348 and from which pen holder 306 extends. A short nub (hidden) extends 
from ball 346, optionally in a direction opposite holder 306. The nub rides in the slots of two 
slotted arc elements 332 and 334, which are optionally generally orthogonal to each other. A 
pair of motor 324 and 326 are each coupled to an arc elements by couplings 328 and 330, for 
example a worm-gear coupling. 

Ring 348 is mounted in x-y table 302, for example using a brace 336 and a finger 322 
that couples to the motion mechanism of x-y table 302, as described below. 

Motors 324 and 326 may include encoders or separate encoders or other position 
sensors may be provided (not shown). 

When setting a pen orientation, controller 102 determines a desired angular setting of 
ball 346. Motors 324 and 326 rotate arc elements 332 and 334, which, by engaging the short 
nub at the intersection of their slots, cause ball 346 to rotate relative to ring 348 (which is 
prevented from rotating). 

Optionally, ball 346 is balanced for example, the short nub being weighed to counter- 
act the torque caused by pen 210 and holder 306, or by providing a suitable weight inside ball 
346. 

Optionally, motors 324 and 326 are neutral, or possibly apply positive feedback, so 
that a user of pen 210 feels little or no resistance, when such null resistance is desired (e.g., 
during monitoring). 

A universal joint may be provided instead of the above described mechanism. 
X-Y TABLE 

As noted above, joint 304 is optionally mounted on an x-y table 302. In an exemplary 
embodiment of the invention, x-y table 302 comprises two orthogonal slotted members 318 
and 320 which are moved by a pair of motors 310 and 312, optionally coupled thereto by a 
pair of bands 314 and 316. In an exemplary embodiment of the invention, finger 322 is 
engaged by the crossing of the slots of slotted members 3 1 8 and 320. 

Other x-y table designs are known in the art and may be used. 

It should be noted that in this described embodiment of the invention, many "natural" 
pen motions will require a coupling between the motion of ball joint 304 and x-y table 302. In 
an exemplary embodiment of the invention, such coupling and coordinated motion between 
the separate motion elements is provided by controller 102. 
CALIBRATION AND PROGRAMMING 
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In an exemplary embodiment of the invention, system 200 is calibrated, for example to 
determine the relative position of pen 210 and the writing target in a resting position. In an 
exemplary embodiment of the invention, the pen is positioned in a resting position and an 
image of the writing target and the pen is acquired. Optionally, the writing target is a display 
5 type writing target which can correct its position based on the calibration. 

Optionally, system 200 is programmed, for example using the input 122 and display 
126. Optionally, programming is by manipulating utensil 101 in a "learn ,, mode. In an 
exemplary embodiment of the invention, a remote link is provided for remote training and/or 
control of the system. 
1 0 UNDER TABLE EMBODIMENT 

Fig. 4 shows system 400, an alternative embodiment of the invention, in which a pen 
402 is held, moved and/or monitored from underneath a table, rather than above it. 

In an exemplary embodiment of the invention, pen 402 is mounted on a surface 404, at 
a point 406. A ball joint 412 (for example like joint 304 of Fig. 3), is coupled to pen 402 via a 
15 rod 408, which, for example, is contiguous with pen 402. Optionally, a spring-loaded base 410 
is provided for rod 408, to accommodate changes in the distance between point 406 and all 
412. Optionally, pen 402 is axially retractable from rod 408, at least for a short distance, to 
emulate pen lifting. Tension in pen 402 may be used to indicate lifting force. An actuator may 
be provided to provide control of such lifting. 
20 In an exemplary embodiment of the invention, surface 404 is mounted on a structure 

420 which is movable by an x-y table 422, described below. 

In an exemplary embodiment of the invention, ball 412 is passively mounted on an x-y 
table 414, so that changes in orientation of rod 408 (caused by a pair of motors 413 and 415, 
for example) are translated into x-y movement of ball 412 constrained by two orthogonal 
25 slotted elements 416 and 418. Alternatively, table 422 can compensate for the relative motion 
of point 406. 

In an exemplary embodiment of the invention, x-y table 422 comprises a pair of motors 
424 and 430, which move a pair of orthogonal slotted elements 426 and 428, for example 
using a worm drive. 

30 In an exemplary embodiment of the invention, x-y table 422 moves both structure 420 

and surface 404. Optionally, patient 128 wears slippery gloves so that this motion will not be 
bothersome. Alternatively or additionally, x-y table provides motion to compensate for writing 
motion, so that the motion seems more natural. 
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In an alternative embodiment of the invention, the size of surface 404 is made small 
(so the hand can rest on a table) and/or a non-moving resting area is provided for the hand. In 
some embodiments, no table is provided at all. Optionally, the surface 404 is attaches to the 
inner side of a table surface. 
5 Optionally, a moving (relative or absolute) or fixed image are projected on surface 404. 

EATING REHABILITATION SYSTEM 

Fig. 5 is a perspective view of an eating rehabilitation system 500 in accordance with 
an exemplary embodiment of the invention. System 500 includes a table 502 (or system 500 
may be adapted for mounting on standard tables, for example including a suitable frame 516). 
10 An eating target 504, for example a plate may be fixed to table 502 or may be allowed 
movement. A utensil 506, for example a spoon is held by a utensil holder 510 which has a fine 
movement control mechanism 508 associated with it. Mechanism 508 may be the same as 
mechanism 208 described above. Optionally, additional rotational and/or translation degrees 
of freedom are provided. For example, holder 510 may include extension and/or rotation. 
15 Optionally, some degrees of freedom are only sensed. For example, an orientation of utensil 
506 relative to a horizon may be determined using an accelerometer. 

In an exemplary embodiment of the invention, system 500 can be used to rehabilitate 
not only fine movements but also gross movements associated with eating. To this end a gross 
motion mechanism 514 is optionally provided, which adds three degrees of freedom of 
20 translation to mechanism 508 by moving a support arm 512 interconnecting them. 

Optionally, the combination of mechanisms 508 and 514 allows fine motor control to 
be rehabilitated over multiple spatial locations as may be found in many daily tasks, such as 
eating, where fine control is required at the plate, at the mouth and to some degree during a 
trajectory of a spoon. 

25 Optionally, motion control at another point on a body, for example an arm, is provided. 

In an exemplary embodiment of the invention, a robotic arm or other positional controller 518 
is used, which includes an arm rest 520. In one example, controller 518 comprises a slotted 
element mechanism as described above. In another example, controller 518 comprises a ball 
522 and an extendible arm 524, each of which may be powered by one or more motors and/or 

30 sensed by one or more sensors. 

In an exemplary embodiment of the invention, mechanism 514 is as follows. A ball 
526 is held between two apertured plates 528 and 530. One or more motors 532 move ball 
526. An optional brake 534 operates by approximating plates 528 and 530, thereby increasing 
friction on ball 526. An extending arm may be provided as well. 
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In an exemplary embodiment of the invention, mechanism 508 includes a camera or 
other sensors to detect proximity to a mouth and/or a state of the mouth. This may be used to 
assist in training a patient to coordinate the mouth and the hand. Optionally, the camera detects 
a mouth open condition by providing a marker above and a marker below the mouth, and 
5 detecting the distance between the markers. Alternatively, non-marker image processing 

techniques may be used. 

In an exemplary embodiment of the invention, system 500 can be used during eating or 
for feeding the patient. Optionally, any step of the feeding may be temporarily taken over by 
the patient. Optionally, a pause is interpreted as an opportunity to remind the patient of the 
10 next movement, for example using speech feedback or by nudging the utensil in the correct 
direction. 

Optionally, at least one camera 536 is provided to track utensil 506 and detect missing 
of plate 504 (or a serving dish, not shown), or dropping of food, for example at plate 504, at 
the mouth and/or onto the patient. 
15 Optionally, other utensils may be attached, or a pair of utensils may be controlled 

together, for example using multiple fine and/or gross motion mechanism. In one example, a 
cup is controlled. In another example, a fork and a knife are controlled together. In another 
example, two chopsticks are controlled together. Optionally, two separate fine motion 
mechanisms are provided, one for each chopstick. Both fine motion mechanisms are 
20 optionally attached to a same gross motion mechanism. 

In an exemplary embodiment of the invention, machine replacing of the utensils is 
supported. In an exemplary embodiment of the invention, the utensil holder comprises a 
magazine of multiple utensils which may be replaced by machine command. In one example, 
for children, a plurality of different crayons are provided. 
25 While arm rest 520 is optionally movable, in some embodiments of the invention, rest 

520 is used to limit motion of another point of the body. It should be noted that such other 
point fixation and/or control may be used for other tasks, such as writing. 

A particular feature of some embodiments of the invention is that fine motion 
rehabilitation can require high resolution feedback and/or multiple degrees of freedom in a 
30 small volume. In an exemplary embodiment of the invention, one or both of these needs are 
provided by a fine motion mechanism being placed close to the work volume. Optionally, such 
a mechanism can also be light and exhibit less resistance and/or delays to motion. 

Optionally, the fine motion mechanism is stabilized, for example using a relatively 
rigid support. Optionally, a dynamic stabilization is provided. In one example, feedback form 
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a camera is used to apply corrective fine motions (e.g., via the x-y table). In another example, 
the utensil, utensil holder and/or fine motor mechanism includes an accelerometer or other 
suitable sensor. The input from such a sensors is use to close a feedback loop (optionally using 
the pen moving mechanisms) which stabilizes the utensil in space, as desired. 
5 OPTIONAL ADD-ONS 

Systems 100, 200 and 500 may be modified in various ways, for example, using add- 
on elements. In an exemplary embodiment of the invention, patient 128 wears a glove which 
provides EMG measurements of the hand. Alternatively or additionally, such a glove 
electrically stimulates the hand. 
10 Optionally, speech input is provided, for example to allow patient 128 to control the 

operation of the system using voice control. Optionally, a patient can announce a desired code 
word or language word which will define a pattern (e.g., the word itself) to be used for a 
rehabilitation task. 

Optionally, various harnesses are used. In one example, for chopsticks, one chopstick 
15 is controlled by the system and the other chopstick is attached to the hand using a harness 
(e.g., possibly a suitable glove). 

Optionally, a finger harness is provided so that the rehabilitation system can 
manipulate a finger or a part of the hand as if it was a utensil. 

It should be noted that system 200 general controls only an end point of the motion 
20 (e.g., the utensil). For controlling the motion in greater detail, more points on the limb (e.g., 
using positioning systems as shown in Fig. 5) or motion restricting means, are optionally used. 
EXEMPLARY SIZES 

In an exemplary embodiment of the invention, the fine motion mechanism covers (can 
move a utensil in) a volume of, for example, less than 30 cm on a side, less than 20 cm on a 
25 side or less than 10 cm on a side. Optionally, the volume has a minimal extent of less than 2 
cm. 

In an exemplary embodiment of the invention, a gross motion mechanism covers a 
volume of, for example, between 20 and 100 cm on a side. Optionally, the volume is 
cylindrical, for example with a diameter of 40 cm or less. The axis may be curved. 
30 Optionally, the fine motion mechanism can apply forces of 1 Kg or less. In other 

embodiments, greater forces are applied. Optionally, an accuracy of force application of 100 g, 
10 g, 1 g or less are provided, in one or more degrees of freedom of the system. 
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Optionally, the accuracy of utensil tip placement is within 5mm, 3 mm, 2 mm, 1 mm or 
less. An angular accuracy is, for example, within 10 degrees, 5 degrees 1 degree, 0.5 degrees 
or less. 
USAGE 

Various ways of using a rehabilitation system are described in the above application. In 
particular, it is noted that the systems described herein may be used at home attached to 
everyday work stations, such as tables and counters. Optionally, the rehabilitation system 
stores logs, results, activities, plans, progress reports and/or other data, locally. Alternatively 
or additionally, some or all of such data is stored remotely. 

In an exemplary embodiment of the invention, the embodiments of the system 
described herein are used for activity assistance. For example, the system is used for assistance 
with writing or eating. Optionally, embodiments of the system described herein are used for 
exercise. 

In an exemplary embodiment of the invention, a network of rehabilitation systems is 
used for collaborative or competitive activities, for example races. 

Optionally, the rehabilitation system is connected to a television set or a virtual reality 
(VR) set (e.g., goggles), to support immersion of the patient during rehabilitation. 

In some exemplary embodiment of the invention, the utensil tracked is a free utensil 
which is used to provide feedback but not apply force. 

In an exemplary embodiment of the invention, the rehabilitation system is used for 
evaluation. Optionally, evaluation includes evaluation for testing progress and/or evaluation 
for determining ability to carry out certain everyday activates. Optionally, the results of tests 
with various handicaps (e.g., utensil designs, force fields, tasks, targets and/or time 
constraints) are optionally used to assess which type of utensil and/or daily task a patient 
should use. 

Optionally, evaluation is periodic, for example, to assess progress and/or to determine 
if a plateau of improvement has been reached. Various valuation methods, for example, 
screwing a bolt, assembling objects, using scissors, sorting and tower building may be used. 
Optionally, the rehabilitation system is used, for example, to assist a patient during testing 
(e.g., determine what residual control a patient has), to apply constraints, to guide, to monitor 
and/or to remind the patient. 

In an exemplary embodiment of the invention, the motion is related to music, for 
example, as described in US provisional application no. 60/633,429 filed on December 7, 
2004, also being filed as PCT application on same date as the present application and by the 
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same applicant, entitled "Rehabilitation with Music" and having attorney docket number 
414/04396, the disclosures of which are incorporated herein by reference. For example, a 
correct motion may generate a correct musical note. In another example, spatial locations are 
associated with musical notes that should be played in a certain sequence. In an exemplary 
embodiment of the invention, the use of music assists a therapist in tracking the patient's 
behavior, without crowding the patient and peering at finger motions. 

Various designs for robots and positioning devices (e.g., hexapods) are known in the 
art. It should be appreciated that various ones of the statements described herein may be 
adapted for such robots and/or positioning devices, in accordance with exemplary 
embodiments of the invention. Alternatively or additionally, software may be provided for 
such robots and devices for carrying out various of the methods described herein, all in 
accordance with exemplary embodiments of the invention. 

In some embodiments of the invention, the systems described herein are used for uses 
other than rehabilitation, for example, task training, testing and/or robotic manipulation. 

It will be appreciated that the above described methods of rehabilitation may be varied 
in many ways, including, omitting or adding steps, changing the order of steps and the types of 
devices used. In addition, a multiplicity of various features, both of method and of devices 
have been described. In some embodiments mainly methods are described, however, also 
apparatus adapted for performing the methods are considered to be within the scope of the 
invention. It should be appreciated that different features may be combined in different ways. 
In particular, not all the features shown above in a particular embodiment are necessary in 
every similar embodiment of the invention. Further, combinations of the above features are 
also considered to be within the scope of some embodiments of the invention. Also within the 
scope of the invention are kits which include sets of a device, one or more tearing pins, one or 
more attachments and/or software. Also, within the scope is hardware, software and computer 
readable-media including such software which is used for carrying out and/or guiding the steps 
described herein, such as control of arm position and providing feedback. Section headings are 
provided for assistance in navigation and should not be considered as necessarily limiting the 
contents of the section. When used in the following claims, the terms "comprises", "includes", 
"have" and their conjugates mean "including but not limited to". It should also be noted that 
the device is suitable for both males and female, with male pronouns being used for 
convenience. 
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It will be appreciated by a person skilled in the art that the present invention is not 
limited by what has thus far been described. Rather, the scope of the present invention is 
limited only by the following claims. 
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CLAIMS 

1 . An apparatus for rehabilitation, comprising: 
5 an object adapted to be hand-held by a person and manipulated using the fingers to 

perform a task; and 

a fine motion mechanism coupled to said object and adapted to apply sufficient force 
to move the object. 

10 2. An apparatus according to claim 1, wherein said apparatus weighs less than 30 kg. 

3. An apparatus according to claim 1 or claim 2, wherein said object is adapted to be 
translated along a surface. 

15 4. An apparatus according to claims 1-3, wherein said mechanism has a range of motion 
of less than 20 cm. 

5. An apparatus according to any of claims 1-4, and comprising a controller that analyzes 
motion of the object to determine at least one characteristic of the person. 

20 

6. An apparatus according to any of claims 1-5 wherein the controller analyzes force 
applied to the object to determine at least one characteristic of the person. 

7. An apparatus according to claim 5 or claim 6 wherein the characteristic comprises an 
25 emotional state of the person. 

8. An apparatus according to any of claims 5-7 wherein said controller has stored therein 
patterns of motions. 

30 9. An apparatus according to claim 8, wherein said patterns include writing patterns. 

10. An apparatus according to any of claims 1-9, wherein said fine motion mechanism 
resists motion of said object by the person. 
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11. An apparatus according to any of claims 1-10, wherein said fine motion mechanism 
applies resistance to motion of said object. 

12. An apparatus according to any of claims 1-11, wherein said fine motion mechanism 
5 assists with the movement of said object. 

13. An apparatus according to any of claims 1-12, wherein said object is equipped with at 
least one feedback source which imparts a stimulus to a user of the apparatus. 

10 14. An apparatus according to any of claims 1-13, further at least one sensor to track 
motion of said object. 

15. An apparatus according to any of claims 1-14, further comprising at least one sensor to 
track force applied to said object. 

15 

16. An apparatus according to any of claims 1-15, wherein mechanism damps motion of 
said object. 

17. An apparatus according to any of claims 1-16, comprising a gross motion mechanism 
20 adapted to move said fine motion mechanism, in at least 2 degrees of freedom. 

18. An apparatus according to claim 17, wherein said gross motion mechanism is adapted 
to move said object from a table to a mouth of a patient. 

25 1 9. An apparatus according to claim 1 8, wherein said object comprises a chopstick. 

20. An apparatus according to any of claims 1-19, comprising a separate gross motion 
mechanism adapted to be attached to a person having said fingers and whose movement is 
coordinated with movement of said object. 

30 

21 . An apparatus according to any of claims 1-20, comprising a surface for said object to 
touch and which surface also functions as a display. 

22. An apparatus according to claim 21, wherein said surface comprises a tablet computer. 

24 



WO 2005/075155 PCT/IL2005/000139 

23. An apparatus for rehabilitating motor control functions related to writing, comprising: 
a surface; 

a stylus extending upwards from the surface; and 
5 a motion mechanism located under the surface that is adapted to change the orientation 

of the pen relative to the surface. 

24. An apparatus according to claim 23, wherein said motion mechanism is adapted to 
move said stylus on said surface. 

10 

25. An apparatus according to claim 23, wherein said motion mechanism is adapted to be 
moved by a person holding the stylus. 

26. An apparatus according to any of claims 23-25, wherein said apparatus is adapted to 
15 measure a force applied to said stylus. 

27. An apparatus according to any of claims 23-26, wherein said apparatus comprises a 
controller having at least one pattern of motion stored therein. 

20 28. An apparatus according to claim 27, wherein said controller controls said motion 
mechanism responsive to said pattern. 

29. An apparatus according to claim 27, wherein said controller measures a mental state of 
a patient responsive to motion of said motion mechanism. 

25 

30. A method of fine motor control rehabilitation, comprising: 
providing an object to be manipulated by fingers of a patient; and 

controlling an actuator coupled to the object to provide assistance to movement of the 
object, said actuator providing a range of motion to the object limited to less than 30 cm and 
30 having at least 3 degrees of freedom of motion. 

31. A method according to claim 30, wherein said assisted motion comprises writing. 

32. A method according to claim 30, wherein said assisted motion comprises eating. 
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33. A method of assisting a person in a daily task that involves controlling arm and finger 
motion comprising: 

determining at least one characteristic of the task; and 
using a robotic actuator to assist arm and/or finger motion. 

34. A method according to claim 33, comprising assisting only if said act fails to complete. 

35. A method according to claim 33, comprising assisting as a safety measure. 

36. A method according to claim 33, comprising assisting periodically as part of a 
rehabilitation process. 
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